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IMAGE PROCESSING METHOD AND IMAGE PROCESSING APPARATUS 



BACKGROUND OF THE INVENTION 

The present invention relates to an image 
processing method and an image processing apparatus 
suitable for a multi-format data broadcast image such as 
a digital broadcast image, for example. 

A conventional television receiver has dealt with 
only single - format image signals, and thus has not 
processed image signals in different formats. However, BS 
digital broadcast requires processing of data broadcast 
data and still image broadcast data that are in a 
broadcast format different from that of a conventional 
image signal. 

Fig. 1 shows a conventional multi-format data 
broadcast image. When a still image 44 and characters 45 
are displayed together with a moving image 43 in the data 
broadcast image 42 on a single screen, an HD (High 
Definition) image 41 can be displayed with high quality, 
while edges of the still image 44 and the characters 45 
shine, thus making the still image 44 and the characters 
45 less easy to see. 

However, when the still image 44 and the characters 
4 5 are displayed together with the moving image 43 in the 
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above-mentioned conventional multi-format data broadcast 
image 42 on a single screen, areas of the still image 44, 
the characters 45, and the moving image 43 cannot be 
distinguished from each other because the still image 44, 
the characters 45, and the moving image 43 are mixed with 
each other to form a single image. Therefore, the still 
image 44, the characters 45, and the moving image 43 
cannot be processed independently of each other for 
higher image quality. This results in a disadvantage in 
that although the HD image 41 can be displayed with high 
quality, the still image 44 and the characters 45 are 
lowered in image quality. 

SUMMARY OF THE INVENTION 

It is accordingly an object of the present 
invention to provide an image processing method and an 
image processing apparatus that improve quality of 
display images in different formats . of a multi-format 
data broadcast image. 

The image processing method according to the 
present invention comprises the steps of: separating data 
in a plurality of formats from a broadcast video signal; 
generating a layer image signal such that the image 
signal of data in each of the formats is superimposable 
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on the data in the plurality of formats; and subjecting 
the superimposed layer image signal to adaptive image 
processing according to a preset parameter. 

Therefore, by subjecting each layer to different 
image processing irrespective of the type and the format 
of the signal, it is possible to perform image processing 
adapted to each format. 

Also, the image processing method according to the 
present invention generates a display section signal for 
each layer image signal. Therefore, by determining a 
display area for each layer, it is possible to readily 
perform different image processing for each layer. 

In addition, the image processing method according 
to the present invention generates the layer image signal 
and the display section signal on the basis of an 
arbitrarily changeable form. Therefore, it is possible to 
readily generate the signals on the basis of the 
changeable form. 

Moreover, the image processing apparatus according 
to the present invention comprises: separating means for 
separating data in a plurality of formats from a 
broadcast video signal; layer image signal generating 
means for generating a layer image signal such that the 
image signal of data in each of the formats is 
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superimposable on the data in the plurality of formats; 
and adaptive image processing means for subjecting the 
superimposed layer image signal to adaptive image 
processing according to a preset parameter. 

Therefore, by subjecting each layer to different 
image processing irrespective of the type and the format 
of the signal, it is possible to perform image processing 
adapted to each format. 

The image processing apparatus according to the 
present invention further includes storage means for 
storing a parameter in a table. Therefore, it is possible 
to make automatic setting for adaptive image processing. 

In addition, the image processing apparatus 
according to the present invention sets a parameter 
according to the status of a layer image signal. 
Therefore, it is possible to adjust image quality by 
performing adaptive image processing according to the 
status of a layer image signal while viewing a data 
broadcast image on a television receiver. 

Thus, according to the present invention, the 
following actions are performed. 

The separating means subjects a video signal 
inputted thereto to digital processing to thereby 
separate menu data, character data, still image data, and 
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moving image data. The separating means supplies the menu 
data, the character data, the still image data, and the 
moving image data to the layer image signal generating 
means . 

The layer image signal generating means generates 
an OSD layer from the menu data, a character layer from 
the character data, a still image layer from the still 
image data, and a moving image layer from the moving 
image data. The layer image signal generating means 
generates an image signal for each of the OSD layer, the 
character layer, the still image layer, and the moving 
image layer. 

The layer image signal generating means also 
generates a display section signal for each of the OSD 
layer, the character layer, and the still image layer, as 
well as layer image signals on which the OSD layer, the 
character layer, and the still image layer are 
superimposed. The layer image signal generating means 
supplies the display section signal for each of the 
layers and the superimposed layer image signals to the 
adaptive image processing means. 

The adaptive image processing means reads preset 
image processing parameters stored in a parameter table 
in a table form. An image processing unit subjects each 



of the layer image signals to adaptive image processing 
for an area of its display section signal according to 
the parameters stored in the parameter table. 

The above and other objects, features and 
advantages of the present invention will become apparent 
from the following description and the appended claims, 
taken in conjunction with the accompanying drawings in 
which like parts or elements denoted by like reference 
symbols . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a conventional multi-format data 
broadcast image ; 

Fig. 2 is a configuration block diagram showing a 
multi- format adaptive image processing system to be 
applied to an embodiment of the present invention; 

Figs. 3A, 3B, and 3C illustrate layer pasting of 
multi -format data and parameter setting for each layer. 
Fig. 3A showing a moving image, Fig. 3B showing a still 
image, and Fig. 3C showing characters; and 

Fig. 4 shows an adaptive processed multi -format 
data broadcast image. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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An image processing method according to an 
embodiment of the present invention generates a layer 
image signal and a display section signal for each layer 
when displaying signals in different formats 
simultaneously on a single screen. The image processing 
method can thereby perform image processing with optimum 
image quality parameters for each display area to display 
the signals. 

Fig. 2 shows configuration of a multi-format 
adaptive image processing system to be applied to the 
present embodiment. In this case, data in each format is 
sent by BS digital broadcast, for example. 

A digital processing unit 1 in Fig. 2 subjects a BS 
digital broadcast signal SI inputted thereto to digital 
processing to thereby separate menu data Dl, character 
data D2, still image data D3 , and moving image data D4 . 

A multi-screen processing unit 2 generates a multi- 
screen video signal S5 for multi -screen display and a 
display section signal S7 for the moving image data D4 
from HD video S2 inputted to the multi -screen processing 
unit 2 and the moving image data D4 supplied from the 
digital processing unit 1. 

A layer generating and media superimposing unit 3 
generates an OSD (On Screen Display) layer 4 from the 
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menu data Dl supplied from the digital processing unit 1, 
a character layer 5 from the character data D2 , a still 
image layer 6 from the still image data D3, and a moving 
image layer 7 from the moving image data supplied from 
the multi-screen processing unit 2. 

The layer generating and media superimposing unit 3 
also generates a display section signal S4 for each of 
the OSD layer 4, the character layer 5, and the still 
image layer 6 as well as layer image signals S3 on which 
the OSD layer 4, the character layer 5, and the still 
image layer 6 are superimposed. 

A CRT driver 8 reads preset image processing 
parameters stored in a parameter table 9 in a table form. 
An image processing unit 10 subjects each of the layer 
image signals S3 to optimum image processing for an area 
of it's display section signal S4 according to the 
parameters stored in the parameter table 9. Also in the 
case of the multi-screen video signal S5, the CRT driver 
8 performs optimum image processing using S5 and S7 . 

The thus formed multi- format adaptive image 
processing system applied to the present embodiment 
operates as follows. The multi -format adaptive image 
processing will be described in the following with 
reference to Figs. 3A, 3B, and 3C. 
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Figs. 3A, 3B, and 3C illustrate layer pasting of 
multi - format data and parameter setting for each layer. 
Fig. 3A shows a moving image; Fig. 3B shows a still 
image; and Fig. 3C shows characters. 

The digital processing unit 1 in Fig. 2 subjects 
the BS digital broadcast signal SI inputted thereto to 
digital processing to thereby separate the menu data Dl, 
the character data D2 , and the still image data D3 . The 
digital processing unit 1 supplies the menu data Dl, the 
character data D2 , and the still image data D3 to the 
layer generating and media superimposing unit 3. 

In this case, the still image data D3 corresponds 
to the still image 22 shown in Fig. 3B, and the character 
data D2 corresponds to the characters 23 shown in Fig. 3C. 

The multi -screen processing unit 2 generates the 
multi -screen video signal S5 and the display section 
signal S7 from the HD video S2 inputted to the multi- 
screen processing unit 2 and the moving image data D4 
supplied from the digital processing unit 1. The multi- 
screen processing unit 2 supplies the moving image data 
D4 to the layer generating and media superimposing unit 3, 
and supplies the multi -screen video signal S5 and the 
display section signal S7 to the CRT driver 8. 

For simplicity. Fig. 3A shows a single frame of 
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moving image. 

In this case, the moving image data corresponds to 
the high-quality moving image 21 shown in Fig. 3A. 

The layer generating and media superimposing unit 3 
generates the OSD layer 4 from the menu data Dl supplied 
from the digital processing unit 1, the character layer 5 
from the character data D2 , the still image layer 6 from 
the still image data D3 , and the moving image layer 7 
from the moving image data D4 supplied from the multi- 
screen processing unit 2. The layer generating and media 
superimposing unit 3 then supplies the OSD layer 4, the 
character layer 5, the still image layer 6, and the 
moving image layer 7 to the CRT driver 8. 

In Figs. 3A, 3B, and 3C, the OSD layer does not 
have data, and therefore the OSD layer is not shown in 
the figures. 

In this case, the character layer 5 corresponds to 
a character layer 26 shown in Fig. 3C; the still image 
layer 6 corresponds to a still image layer 25 shown in 
Fig. 3B; and the moving image layer 7 corresponds to a 
moving image layer 24 shown in Fig. 3A. Images of the 
layers are thus pasted to the display area. 

Incidentally, each of the layer image signals may 
be set into a preset, arbitrarily changeable form. 
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The layer generating and media superimposing unit 3 
also generates a display section signal S4 for each of 
the OSD layer 4, the character layer 5, and the still 
image layer 6 as well as the layer image signals S3 on 
which the OSD layer 4, the character layer 5, and the 
still image layer 6 are superimposed. The layer 
generating and media superimposing unit 3 supplies the 
display section signal S4 for each of the layers and the 
superimposed layer image signals S3 to the CRT driver 8 . 

In this case, the display section signal S4 for the 
character layer 5 corresponds to a display section signal 
C of horizontal HC X vertical VC shown in Fig. 3C; the 
display section signal S4 for the still image layer 6 
corresponds to a display section signal B of horizontal 
HB X vertical VB shown in Fig. 3B; and the display 
section signal S4 for the moving image layer 7 
corresponds to a display section signal A of horizontal 
HA X vertical VA shown in Fig. 3A. 

Incidentally, each of the display section signals 
may be outputted so as to correspond to a preset, 
arbitrarily changeable form. 

The CRT driver 8 reads preset image processing 
parameters stored in the parameter table 9 in a table 
form. The image processing unit 10 subjects each of the 
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layer image signals S3 to optimum image processing for an 
area of its display section signal S4 according to the 
parameters stored in the parameter table 9. 

In this case, parameter settings stored in the 
parameter table 9 are: parameter settings C (29) for the 
character layer 26 shown in Fig. 3C; parameter settings B 
(28) for the stiii image layer 25 shown in Fig. 3B; and 
parameter settings A (27) for the moving image layer 24 
shown in Fig. 3A. 

In this case, in the parameter settings C (29) for 
the character layer 26, image processing for sharpness, 
VM, dynamic picture, and hyper-white is off and therefore 
is not performed, while color temperature is set 
relatively high. 

In the parameter settings B (28) for the still 
image layer 25, image processing for sharpness, dynamic 
picture, and hyper-white is off and therefore is not 
performed, VM image processing is performed relatively 
weakly, and color temperature is set relatively low. 

In the parameter settings A (27) for the moving 
image layer 24, sharpness image processing is performed 
moderately, VM image processing is performed relatively 
strongly, image processing for dynamic picture and hyper - 
white is on and therefore is performed, and color 
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temperature is set relatively high. 

It is to be noted that the sharpness processing 
enhances image sharpness. The VM processing provides a 
three-dimensional appearance to the image by slowing a 
sweep rate when luminance difference is large and 
normalizing the sweep rate when luminance difference is 
small. The dynamic picture processing makes details clear 
by setting a portion of the lowest (black) level in a 
signal as black. The hyper-white processing enhances 
white level. The color temperature processing renders 
white in a movie and other images sepia. 

Fig. 4 shows an adaptive processed multi-format 
data broadcast image after being subjected to the above 
image processing. 

A data broadcast image 31 in Fig. 4 displays a 
moving image 32 subjected to the adaptive image 
processing with parameters A (35) , a still image 33 
subjected to the adaptive image processing with 
parameters B (36), and characters 34 subjected to the 
adaptive image processing with parameters C (37) . 

In this case, since according to the set parameters 
A (35) , the sharpness processing is performed moderately, 
the sharpness of the moving image 32 is set to a moderate 
level. Since the VM processing is performed relatively 

13 



strongly, the sweep rate is slowed relatively strongly 
when luminance difference is large and is normalized 
relatively strongly when luminance difference is small. 
Since the dynamic picture processing is performed, the 
lowest black level is raised to make details clear. Since 
the hyper-white processing is performed, white level is 
enhanced. Since the color temperature is set relatively 
high, white in a movie and other images is rendered sepia. 

Since according to the set parameters B (36) , the 
sharpness processing is not performed, the sharpness of 
the still image 33 is set to a low level. Since the VM 
processing is performed relatively weakly, the sweep rate 
is slowed relatively weakly when luminance difference is 
large and is normalized relatively weakly when luminance 
difference is small. Since the dynamic picture processing 
is not performed, black level is not changed. Since the 
hyper-white processing is not performed, white level is 
not enhanced. Since the color temperature is set 
relatively low, white remains as it is. 

Since according to the set parameters C (37) , the 
sharpness processing is not performed, the sharpness of 
the characters 34 is set to a low level. Since the VM 
processing is not performed, the sweep rate is not slowed 
even when luminance difference is large and is not 
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normalized even when luminance difference is small. Since 
the dynamic picture processing is not performed, black 
level is not changed. Since the hyper-white processing is 
not performed, white level is not enhanced. Since the 
color temperature is set relatively high, white is 
rendered sepia. 

Thus, since the layer image signal and the display 
section signal are generated for each of the layers, the 
image processing unit in the succeeding stage can 
determine an image processing area by means of the 
display section signal. This allows the above - described 
adaptive image processing for sharpness, VM, dynamic 
picture, hyper-white, and color temperature to be 
performed for each of the layers according to the set 
parameters A (35) , B (36) , or C (37) . 

It is to be noted that the parameter settings are 
not limited to those described above; the parameter 
settings may be changed for each layer and according to 
the status of a layer image signal. This makes it 
possible to adjust image quality by performing adaptive 
image processing according to the status of a layer image 
signal while viewing a data broadcast image on a 
television receiver. 

Also, the kinds and descriptions of parameters are 
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not limited to those described above; other image 
processing for enhancing or blurring an edge of an image 
and image processing in a Y system, a color difference 
system, and an R, G, and B system may be used. 

In addition, the image quality of a still image may 
be improved so as to match the high quality of a moving 
image by performing interpolation processing and the like. 

Moreover, another image may be used as a background 
in the display section area for characters. 

Furthermore, a moving image, a still image, and 
character data may be inputted from a recording apparatus 
such as a digital camera or a personal computer. 

It is also to be noted that the present embodiment 
has been described by taking only BS digital broadcast as 
an example; however, the present invention is of course 
applied to terrestrial digital broadcasts and cable 
digital broadcasts. 

In addition, optimum image processing between 
moving images can be performed by using a multi-screen 
function. Even when an NTSC (narrow video band) image is 
displayed on a left screen and an HD (wide video band) 
image is displayed on a right screen, a video parameter 
for the left screen and a video parameter for the right 
screen can be set independently of each other. 
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While a preferred embodiment of the present 
invention has been described using specific terms, such 
description is for illustrative purposes only, and it is 
to be understood that changes and variations may be made 
without departing from the spirit or scope of the 
following claims. 
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